Constrained spin dynamics description of random walks on hierarchical scale-free 

networks 
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We study a random walk problem on the hierarchical network which is a scale-free network grown 
deterministically. The random walk problem is mapped onto a dynamical Ising spin chain system 
in one dimension with a nonlocal spin update rule, which allows an analytic approach. We show 
analytically that the characteristic relaxation time scale grows algebraically with the total number 
of nodes N as T ~ N z . From a scaling argument, we also show the power-law decay of the 
autocorrelation function Ccr(t) ~ t~ a , which is the probability to find the Ising spins in the initial 
state er after t time steps, with the state-dependent non-universal exponent a. It turns out that 
the power-law scaling behavior has its origin in an quasi-ultrametric structure of the configuration 
space. 
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I. INTRODUCTION 

Complex networks, as for instance represented by the 
Internet, the social acquaintance network between indi- 
viduals, biological networks of interacting proteins, and 
others (see Ref. Q for further examples), became recently 
a central research focus in statistical physics. In general 
a network consists of a set of nodes (sites or vertices) and 
a set of edges (bonds or arcs) , connecting the nodes with 
one another. A system with many interacting degrees 
of freedom, e.g., computers, individuals, proteins etc., or 
generally called agents, can be modeled by a network by 
identifying the agents as the nodes and the interaction 
between them as the edges. Real world networks neither 
have a regular structure (as for instance periodic lattices 
or grid graphs have) nor a fully random structure @. 
They rather display a broad distribution of the degree, 
where the degree K of a node is the number of neigh- 
bors connected to it. Some networks, the so-called scale- 
free networks , display a power-law degree distribution 
P{K) ~ K^ 1 ', which is is found in various disciplines. 

The heterogeneous structure of scale-free networks has 
a significant influence on thermodynamic or dynamic sys- 
tems embedded into them. For instance, the nature of 
equilibrium or noncquilibrium 5] phase transitions are 
quite different from those observed in corresponding sys- 
tems on regular periodic lattices. In the present work we 
are interested in the nature of diffusive and relaxational 
dynamics performed by a random walker in scale-free hi- 
erarchical network [(|. As a very recent application we 
note that in the context of peer-to-peer computer net- 
works random walk search strategies have been proposed 
HL E} m which a query message is forwarded to a 
randomly chosen neighbor at each step until the desired 
object (typically a particular data set) is found. In view 
of these algorithmic developments it appears therefore 
quite natural and important to study random walks on 



complex networks. In addition .the random walk is a 
fundamental stochastic process [10( and turns out to be 
a useful tool in characterizing the structure of complex 
networks [H H El . 

In regular networks of periodic lattices in D dimension, 
the random walk motion is characterized by normal diffu- 
sion which is characterized by a length scale that grows 
algebraically as £ ~ t 1 / 2 in time t. The exponent 1/2 
is universal, i.e. it does not depend on the microscopic 
details of the lattice — the only condition being that 
only nearest neighbor jumps on a regular D-dimensional 
lattice are allowed. The autocorrelation function C(t) 
or the return probability to the initial node in t time 
steps decays algebraically as C(t) ~ t~ D / 2 . On random 
networks, on the other hand, the autocorrelation func- 
tion shows a stretched-exponential decay as C(t) ~ e~ at& 
with (3 = 1/3 0. 

Random walks were also studied in the small-world 
network of Watts and Strogatz Q , which interpolates be- 
tween regular networks and random networks by stochas- 
tically changing connections between nodes with a par- 
ticular rewiring probability p\y . In essence a small- world 
network is obtained from a regular network with edges of 
fraction pw being replaced by shortcuts connecting pairs 
of nodes selected randomly. For nonzer o pw - an inter- 
esting crossover behavior is observed |15l [16J : A random 
walk obeys the scaling law for regular networks for short 
times t -C r, and then that for the random networks for 
large times t ^> r. The crossover time scale r is deter- 
mined by the time interval at which a random walker hits 
shortcuts. Since the mean distance between shortcuts is 
£ ~ Pw, the crossover time scales as t ~ f ~ p^ 2 . 
For t 3> t, it is numerically found that the autocorrela- 
tion function also shows a stretched-exponential decay as 
C{t) - e- at ' 3 with /9 ~ 1/3 

There has been a growing interest rece ntly in the study 
of random walks on scale- free networks 1191 i2CI . In this 
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paper, we focus on random walks on a hierarchical net- 
work, which is a model for a scale-free network with a 
modular structure @. Unlike most scale- free network 
models it is a deterministic network as those of Jung et 
al. |2l| and Dorogovtsev et al. • Due to its determinis- 
tic nature a number of characteristic structural features 
are known exactly j2^|. As we will see in the follow- 
ing, we can study various properties of the random walk 
analytically. The analytic results will shed light on the 
stochastic processes in general scale-free networks. 

The paper is organized as follows: In Sec. [HI the hi- 
erarchical network model and the random walk is intro- 
duced. Our results for the scaling laws for the relaxation 
time and the autocorrelation functions are presented in 
Sec. IIIII These results are derived with the help of an 
exact mapping of the random walk problem to a con- 
strained dynamics of an Ising spin chain, the details of 
which mapping are described in Sec. IIVI We also find 
that a random walk on a hierarchical network is similar 
to the diffusion in ultrametric space, which is elaborated 
in Sec. Finally we summarize our work in Sec. IVII 



II. MODEL 

Some biological networks which are scale-free exhibit 
a modular structure, which is not incorporated into most 
scale-free network models. The hierarchical network has 
been proposed as a model for the scale-free networks with 
the modular structure [(j. It is constructed iteratively 
starting from a seed (first generation) Gi consisting of a 
hub and (M — 1) peripheral nodes. They are fully con- 
nected with each other. It is useful to represent the hub 
and the peripheral nodes with the coordinates (0) and 
(y), where y is an integer 1 < y < M 23]. Nodes in Qg, 
the network of the Gth generation, are identified via co- 
ordinates that are G-tuples of integers (a;) = (xq ■ ■ ■ x\). 

From a given graph Q g , the next generation network 
Gg+i is constructed by adding (M — 1) copies of Q g with 
their peripheral nodes connected to the hub of the orig- 
inal Q g . The original hub and the peripheral nodes in 
the copies become the hub and peripheral nodes of Q g +i, 
respectively. Then, each node whose coordinate was (x) 
is assigned to (0a;) if it belongs to the original Q g or to 
(yx) with 1 < y < M if it belongs to the yth copy of Q g . 
So the hub has x n = for all n and a peripheral node has 
x n 7^ for all n. There are M G nodes in Gg, {M — 1) G 
of which are peripheral nodes. Figure shows the con- 
figuration and the coordinate representation of Q2 with 
Al = 5. The iteration can be repeated indefinitely and 
the emerging network is scale- free for M > 3 with the de- 
gree distribution exponent 7 = 1 + In Mj ln(M — 1) [23| . 

The node connectivity is represented by the adjacency 
matrix Ajf, Aj% = 1 if a node i is connected to j or 
otherwise. The network is undirected, hence Aij = Aj. L 
and the connectivity is easily described in terms of the 
coordinates |23| . Hereafter, we will use x for a dummy 
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FIG. 1: The configuration and the coordinate representation 
of C/2 with M — 5. The hub is represented with a filled square, 
and the peripheral nodes are with empty circles. 



index from to M — 1 , while y from 1 to M — 1, and we 
denote the m-tuple of as m . 

The network growth rule implies (a) the existence of 
connections of m-th generation hub to all m-th genera- 
tion peripheral nodes, more precisely in coordinate lan- 
guage: nodes (x) with Xi = for i = l,...,m and 
^ are connected to the following nodes: 



(• • -y m+ iO m ) <-> (■■■y ri 



i0 



m — n Dn 



yi) (i) 



with 1 < n < m. And it implies (b) the existence of con- 
nections between peripheral nodes and lower level hubs 
plus connections to other peripheral nodes within the 
same elementary unit; in coordinate language: a node 
(a;) with Xj = yi ^ for i = 1, . . . , m and x m +i = is 
connected to the following nodes: 



(• --0y m ■■■yx) 



(• • • 0y v 



(• ■■0y m ■ ■■Vn+T-On) 



(2) 



with y'-y ^ yi and 1 < n < m. 

We study a discrete time random walk on the network. 
This stochastic process is defined by the following rules: 
The walker at node i and time t selects one of the neigh- 
bors of i to which i is connected and jumps to this neigh- 
bor at time t + 1. Thus the transition probability for a 
jump from a node i to a node j is given by u>ji — Aji/Ki, 
where Aji is the adjacency matrix and Ki — Aji is 
the degree of the node i. 

This stochastic process in discrete time is described by 
a master equation for the time evolution of Pi(t), the 
probability finding the walker at node i and time t. The 
master equation reads Pj(t + 1) = J2j ^ijPji^)- Equiva- 
lently, defining the state vector \P(t)) = J2i with 
|z) being the state in which the walker is at node i, one 
can rewrite the master equation as \P(t+ 1)) = U\P(t)), 
where U is the transition operator whose elements are 
(U)j, 

In the infinite time limit t — * 00 the probability dis- 
tribution converges to the stationary state distribution 
P°°, which is given by P°° = K l jM with Af ' = for 
the random walk on arbitrary undirected network |12| . 
In the hierarchical network the degree of all nodes are 
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known exactly [23J. For instance, the hub has the largest 
degree 

K h = (M-l)(M-2)- 1 ((M-l) G -l) ~ (Af-1) G , (3) 
and the peripheral node has the degree 

K p = (M — 2 + G) . (4) 
The sum of all degrees is given by 

N = (3M-2)(M-1)M G - 1 -2(M-1) G+1 - M G . (5) 

A quantity of particular interest is the scaling law for 
the relaxation time T, which is the characteristic time 
scale for the approach of the probability distribution 
Pi(t) to the stationary state distribution P°°. Also of in- 
terest is the nature of the relaxation dynamics, for which 
we consider the decay of the autocorrelation function 

C s (t) = , (6) 

which is the overlap between a state \S) with itself after 
t time steps. When \S) — \i), it reduces to the returning 
probability of the random walker to the origin (starting 
node) i after t time steps. In the limit t — > oo the auto- 
correlation function converges to a value determined by 
the stationary state distribution P°° . The scaling behav- 
ior of Cs(t) for t <C T will be studied for various states 
\S). 



instead of to (030000). When it jumps to a wrong node, 
say (030200), first it should hop to a node (0302^), 
and then try another hopping toward the destination. In 
this respect the dynamics we are considering is of a hier- 
archical nature. Utilizing this observation we will show in 
the next section that the associated time scale for the 
process increases exponentially as ~ (M/(M — 1))*. 
We define k = M/(M — 1) for further use. 

Therefore, the relaxation time T, which is given by 
T ~ J^ G T £ i scales exponentially with G as 

T - k g . (7) 

Since N = M G , the relaxation time scales algebraically 
with N as 

T~N Z , (8) 
with the dynamic exponent 

z = huz/1nM. (9) 

B. Autocorrelation function 

To be specific we consider the autocorrelation functions 
for the following states: 

(i) H is the state corresponding to the hub 

\H) = \0 G ) . (10) 



III. RESULTS 

In this section we present our the main results. They 
are derived using the exact mapping of our random walk 
process onto a constrained dynamics of an Ising spin 
chain. Details of the mapping and the derivations of the 
formulas deduced from it and used in the present section 
are delegated to the next section. 

A. Relaxation time 

Consider the motion of the random walker located ini- 
tially on a particular node, say (030201). The memory 
of the initial position will be lost when all components 
x% s are flipped at least once, which defines the relax- 
ation time scale T. The node connectivity summarized 
in Eqs. Q and J2J tells us that xi may flip only when all 
ajj's with j < i are equal to (if X4 = 0) or all are not 
equal to (if Xi 7^ 0). Hence, the random walker should 
follow the path (030201) -> (030200) -> (0302y 2 yi) -> 
(030000) -> {OiymvWi) -» (000000) -> (yeyMvWi) 
to loose the memory of its initial state. 

Each process requires a simultaneous flip of £ compo- 
nents from zero to nonzero values or vice versa, which 
may occur after many trials. For instance, the random 
walker at (0302y 2 2/i) may hop to (0302y 2 0) or (030200) 



(ii) P is the state corresponding to the peripheral nodes 

VX---VG 

(iii) Al and A2 are the states 

lM) = (M^W) £ 1-WiOttiO), (12) 

' ' V2,V4f- 

|A2) = (M-lYo/2) E 1-OwOifc) (13) 

with zero and nonzero components alternating. 

The stationary state probability distribution is deter- 
mined by the degree distribution. Since the degree of 
all nodes is known, it is easy to show that P^f ~ k~ g , 
P^ - Gk- g , and Pjg = P% 2 - (M/y/M - 1)~ G in the 
large G limit. 

The exponential decrease of the stationary state proba- 
bility and the exponential increase of the relaxation time 
suggests a power-law decay of the autocorrelation func- 
tion in time. Indeed, we find that the autocorrelation 
functions decay algebraically for t <§; T as 

C H {t) - f" 01 * (14) 
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C A i(t) ~ C A 2(t) ~ r 



(15) 



(16) 



where a# = ctp = 1 and = ln(M /y/M — T)/ In «; > 1 
with k = M/(M — 1). Quite remarkably, the decay ex- 
ponent depends on the state — a manifestation of the 
fact that the network under consideration is not homo- 
geneous. In addition to the power-law dependency in t, 
the functions Cp(t) and Cn(t) also decay as 1/G and 
1/G 2 , respectively, i.e. algebraically with the number of 
generations in the network. So, the power-law decay in 
time is observed only in finite systems for the states H 
and P, since in the limit G — > oo the functions Ch and 
Cp vanish. 



IV. ISING SPIN CHAIN 

In this section, we explain the exact mapping of the 
random walk problem onto the constrained dynamics of 
an Ising spin chain. 



is invariant under all such permutations. The subspace is 
spanned by the states |er) = \o-q ■ ■ ■ o~\) — \o~g)®- ■ 
where <j n = ± and 



M-i 



M 
10) 



(17) 
(18) 



For example, in G2 with M — 5 as shown in Fig.^ I ) 

corresponds to the state with the walker at the hub, and 
the states | + — ), | — +), and |++) correspond to the states 
in which the walker can be found with equal probability 
on nodes D's, »'s, and o's, respectively. 

One may regard the two-state variable a as the Ising 
spin. Then the random walk problem in the subspace 
reduces to an Ising spin chain with a particular con- 
strained dynamics. In fact, the state defined in the pre- 
vious section are equal to the ferromagnetically and an- 
tiferromagnctically ordered states: 



A. Mapping 



\H) = 

\P) = 

\A1) = 

\A2) = 



- + -+> 



(19) 
(20) 
(21) 
(22) 



Using the coordinate representation of the nodes, one 
may map the state \i) with a random walker at a node 
i = (x) in Qg to a spin configuration |x) = \xq, ■ • ■ , X\) 
of an ill-state Potts spin chain of length G, where x n € 
{0, . . . , M — 1} denotes the state of the spin at site n 
(= 1, . . . , G) in the chain. A jump of the walker corre- 
sponds to a transition between spin configuration. In this 
way the connection rules define the time evolution of the 
spins. 

In the context of spin dynamics, it is useful to define 
a zero domain (ZD) and a nonzero domain (NZD); the 
ZD is a domain of spins that are all in the zero-state, i.e. 
Xi = x i+ i = . . . = x i+ i — 0; and the NZD is one in which 
all spins are in a non-zero state. In particular, a domain 
including the spin x\ will be called a boundary domain. 
The node connectivity imposes the constraint that spins 
outside the boundary domain cannot flip in a given spin 
configuration. So it suffices to consider the transition of 
spins in the boundary domain. Equation (JQ) implies that 
spins in a boundary ZD evolve in one time step accord- 
ing to U\0 m ) = Er=lEji,..,,„ \O m -nVn ■ ■•yi))/^ with 
Q = £r=i( M - 1)". On the other hand, Eq. @ implies 
that spins in a boundary NZD evolve as U\y m ■ ■ ■ y\) = 

(T, v ' l7 t yi \vm-- vWx) + Y2=i \vm"- y n +iO n ))/Q' with 

ft' = (M — 2 + to). Note that the boundary domain 
size decreases in most cases. It increases only when all 
spins in the boundary domain flip. 

The operator U is symmetric under any permutation 
Vn ~ * y'n among nonzero spin states. Taking advantage of 
the symmetry, we restrict ourselves to the subspace which 



The Ising spins evolve as follows: As in the Potts spin 
dynamics, only spins in the boundary domain may flip. 
A boundary domain |i m ) of up/down spins of size to 
evolves in one time step according to 

m 

U\-\- m ) = ^ Pm,n\~\~m— n n) (^3) 
n=0 
m 

^1 m) ^ Qm.n | m— n~T"n) > (^4) 

n=l 

where Pm . n = {{M - 2)8 n $ + (1 - 5 nfi ))/{M - 2 + to) 
and q m . n = (M - l) n / £™ =1 (M - \) k . Each spin state 
has a different multiplicity factor, so the transition prob- 
abilities p m .n and q m ^ n are not uniform in n. Note that 
the spin up-down symmetry is broken for M > 3. It 
is restored for M — 2, in which case the corresponding 
network is not scale-free. 

In Fig. |3 we illustrate a diagram of the configura- 
tion space of the spin chain of length G = 4 display- 
ing the spin configurations and possible transitions be- 
tween them. Qualitative features of the Ising spin dy- 
namics are easily read off from the diagram: (i) The 
configuration space has a tree structure, if one ignores 
self-loops from the states with a -I- boundary domain to 
themselves (p m .o ^ 0). (ii) The configuration space has 
a hierarchical structure, that is, the configuration space 
of Qg contains those of Gc with G' < G as parts (see 
Figure. I2J). 
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FIG. 2: The configuration space of the Ising spin chain of 
length G = 4. Solid (Dashed) lines with the arrow represent 
the transition with the probability q m . n (p m , n ), where m is the 
boundary domain size of a source state and n is the number 
of flipped spins. Self-loops from states with a + boundary 
domain to themselves with weights p m ,o are omitted. The 
parts inside the boxes with a 4 being ignored are equivalent to 
the configuration space of Qz\ the configuration space has a 
hierarchical structure. 



B. Boundary domain growth 

The condition that only spins in a boundary domain 
may flip imposes severe constraint on the spin relaxation 
dynamics. In a given Ising spin configuration, 02 may 
flip after <j\ aligns parallel to it, 03 may flip after g\ 
and (T2 align parallel to it, and then, in general, a m may 
flip after all spins a n with n < to align parallel to it. 
In other words, the boundary domain size grows up to 
to in order to flip a m . The boundary domain growth is 
the essential mechanism in the spin relaxation dynamics. 
In the language of a domain wall, a domain wall at site 
n+1/2, i.e., cr„+i 7^ a n , plays a role of a dynamic barrier 
since it prevents spins a m with m > n from flipping. 

Consider a spin configuration with a boundary domain 
of size to. The size of the boundary domain increases 
only when all m spins inside the domain flip simultane- 
ously. When n < m spins flip, the boundary domain 
size reduces to n. Then the spin system should grow the 
boundary domain size up to m to return to the initial 
state and try another flip to increase the boundary do- 
main size. It shows that the boundary growth process 
has a hierarchical nature, which is inherited from to the 
hierarchical structure of the configuration space. 

We investigate the characteristic time scale associated 
with the boundary domain growth process. Due to the 
hierarchical nature of the dynamics, we find that the 
time scale satisfies a recursion relation. To be more spe- 
cific, we consider the mean first passage time (MFPT) 
C^m )> wn i cn h takes to flip all spins in the bound- 
ary domain of to up (down) spins simultaneously for the 
first time. Note that such time scales do not depend 
on spins outside the boundary domain, so they do not 
depend on the total chain length G. 

Before proceeding, we derive a useful formula for the 
MFPT in a tree-like structure. Consider a node (or state) 
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FIG. 3: Tree-like network. The shaded areas need not have a 
tree structure as long as there is no overlap between different 
parts. 



s which is connected to k nodes ti with i = 1, • • • , k. The 
transition probability from s to ti is given by u>i, and to 
itself by loq (see Fig. . By the tree-like structure, we 
mean that ti can be reached from tj only through s for 
all pairs of i and j, no matter how many loops there are 



in the shaded areas, 
is given by 



Then. T u the MFPT from s to U 



Ti 



(3+T-+T', )uijUj>Wi+- 



where T^, denotes the MFPT from tj to s and Tq is set 
to zero. The first term corresponds to the transition to U 
in a single step, the second term to a round trip via tj^i 
or staying at s followed by the transition to ti, and so on. 
The infinite sum can easily be evaluated which yields 



T 



(25) 



The configuration space of the Ising spin chain has 
a tree structure. So we can make use of the formula in 
Eq. 1)25(1 . Take a spin state with a boundary domain of to 
up spins as s in Fig. |3| It is connected to spin states with 
boundary domains of n down spins (n = 1, . . . , to — 1) 
with the transition probabilities p m ,n, which leads to 



m— 1 

E 

n=l 



Likewise, one also obtains that 



n=l 



Pm.n T n 



(26) 



(27) 



After lengthy but straightforward calculations, the recur- 
sion relations can be solved exactly to yield 

-2 



T +- = 

m 

T-+ = 

ra 

for to > 2 and 
k = M/(M ■ 
with to. 



(3 - 2M) + (3M - 
((3M-2)/M) n m 
- = M - 1 and T; 



2) K r ' 



1 



(28) 
(29) 



= 1. Recall that 
1). The time scales increase exponentially 
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C. Relaxation time 

Consider an arbitrary spin configuration \or) with I do- 
main walls at sites {mx+1/2, . . . , m; + l/2} with m, < m» 
for i < j. The spin state has a boundary domain of size 
mi initially. The spin system loses the memory of the ini- 
tial state when all spins flip at least once. Note that oq is 
the last spin to flip. So, the characteristic relaxation time 
is given by the time at which gq flips for the first time. 
It can flip when all spins align ferromagnetically, which 
requires that spins (J n <mi align, which also requires that 
spins <7 ra < mil align, and so on. Therefore the relaxation 

time is given by T = Yl a =i ^ro T + Tg^. For example, 
the relaxation time for a spin state | H h +) is given by 

t = t+- + t.^+ + T+-. 

Since T^ 1 increases exponentially in m, the sum is 
dominated by the last term Tq T for all spin states. 
Therefore we conclude that the characteristic relaxation 
time averaged over all states scales as T ~ T^,~ ~ Tq , 
which gives T ~ k g , i.e. the important formulas in 
Eqs. Q and ©. 



D. Autocorrelation 

In this subsection, we derive the scaling laws for the 
autocorrelation function Ccr (t) . It measures the strength 
of the memory of the initial state \ar) after time t. The 
spin system loses the memory as more and more spins 
fluctuate. Due to the hierarchical nature of the spin dy- 
namics, the spin fluctuations grow from one boundary of 
the chain, namely, from o\. So, it is useful to define a 
length scale £(t) which is determined by the condition 
that <7 n (t) = cr„(0) for n > £ and cxf(i) 7^ cr^(O), where 
<r(t) denotes the spin state at time t. All spins at sites 
n < £ have flipped at least once up to t. For this rea- 
son, we will call those sites the perturbed domain, and £ 
the perturbed domain size. Roughly speaking, £(t) is the 
maximum size of the boundary domain up to time t. 

First, consider the antiferromagnetically ordered state 
\A\) defined in Eqs. (|12[1 and 1|21[1 . One obtains the same 
results for the state \A2). It is the linear superposition of 
(M— 1) G / 2 states, in which the random walker is located 
at nodes | • • • Oj/aOj/i), each of which has the degree K — 
M — 1. Hence, its stationary state probability is given by 



Pjg ~ (M - lf/ 2+1 /Af ~ r A G 



(30) 



with the chain length G and ta — M/y/M — 1. 

The state \A1) has the highest density of domain walls. 
In such a state, the perturbed domain grows by removing 
the domain walls successively. So, the perturbed domain 
size reaches £ after the time scale ~ £n<£ ~ 
K*. Note that the time scale t% is of the same order of 
magnitude as the relaxation time scale of the spin chain 
of length £. It implies that the spins ■ ■ ■ o\ in the 
perturbed domain are in the stationary state, while those 
spins outside the perturbed domains are frozen at that 




FIG. 4: Numerical results for CUi(i) are represented by the 
symbol plots for M = 2, 3, 4, 5 in the Ising spin chain of length 
G — 100. The solid lines have the slope given by ctAl(M) = 
ln(M/VM - l)/lnre. The inset shows the plot of a A i vs. M. 



time scale. Therefore, (Ta(^) is given by the stationary 
state probability for the antiferromagnetic state in the 
chain of length £, that is in Eq. (|30fl with G replaced 
by £, to yield Cai(^) ~ r A ■ Eliminating £ in t% and 
Cai ftg) , we obtain the power-law decay as written in 
Eq. ffity. 

We confirmed the analytical results with numerical 
simulations of the Ising spin chain. Starting from the 

initial state | • • • H 1 ), a stochastic time evolution 

is generated using the transition rules in Eqs. ill'- it and 
(|24|l and CUi(i) is measured and averaged over indepen- 
dent runs. In Fig.|3] the numerical results are presented. 
They are consistent with the analytic results. 

For the ferromagnetic states \P), one can apply a simi- 
lar scaling argument with a little care. It is a linear super- 
position of (M — 1) G states, in which the random walker 
is located on peripheral nodes with degree M — 1 + G. 
So, its stationary state probability is given by 



P~ = (M - 1 + G){M - l) G /Af - Gk- g 



(31) 



The state does not contain any domain walls. So in the 
beginning it evolves quickly creating domain walls into 
one of states {\n}} with 77 = 1, • • • , G with the transition 
probability pc,n ~ 1/G, where \rj) denotes a state with 
the domain wall at 77 + 1/2, i.e., a n>r) — + and = — . 
After this, the boundary domain growth takes place for 
each j n) independently. After a time scale t ~ k>, the 
spins o~j= • • • <j\ in the state \n = £) reaches the stationary 
state with the probability for them to be in the ferromag- 
netic up state is given by P£P in Eq. (|3*T)l with G replaced 
by £, i.e., £rp^. Therefore the value of the autocorrela- 
tion function is given by Cp{t^) ~ £rp/G where 1/G is 
the transition probability from |P) to (77 = £). Eliminat- 



ing £ using t ? 



we obtain the result in Eq. (|15[l in 



the leading order. 

Analogously, the state \H) evolves into one of the 
states with £ = 0, • • • , G, where |C) denotes a state 
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FIG. 5: Numerical results for Cp(t) and Cnii) for different 
values of G (as listed in the inset) with M = 5. The solid 
lines have the slope — 1. 



with the domain wall at C + 1/2, i.e., cr n >c = — and 
er<; = +. In this case, however, the transition probability 
qc.c ~ (A/ — 1)^ increases exponentially with (. Hence 
we can ignore the other states except for the state with 
£ = G, that is \P). Therefore, the autocorrelation func- 
tion Cu(t) for \H) is given by Cp(t — 2) multiplied by 
the transition probability pg,g from \P) to \H), which 
results in Eq. ifTIJl. 

The scaling behavior of Cp(t) and Cjj(t) is also con- 
firmed via the numerical simulations. In Fig. [5] we show 
a plot of the autocorrelation function evaluated in the 
Ising spin chain of length G < 400 with M = 5. As G 
increases, the decay follows the power law in t with the 
exponent —1. We also checked that the power-law scal- 
ing regime overlaps in the plots of GCp{t) and G 2 Ch (t) 
vs t. 

It is easy to generalize the argument for the autocor- 
relation function to an arbitrary state |er) whose station- 



ary state probability scales as Pg 



~ G . Since the 



perturbed domain size grows in time as £ ~ hit/ Inn, 
the value of C<r(t) at t ~ k£ is given by the stationary 
state probability for the spin configuration ae • • • a\ in 
the chain of length £, i.e., Ccr(t ~ k«) ~ r~*. Elim- 
inating £, one obtains that Ccr(t) ~ £ _ct with a state- 
dependent exponent a = lnr/ln/t |24j| . The stationary 
state distribution is determined by the degree distribu- 
tion. Therefore, we conclude that the non-universality 
(i.e. state dependence) of the decay exponent is a con- 
sequence of the broad distribution of the degree in the 
underlying network. 



V. ULTRAMETRIC DIFFUSION 

In the preceding sections it turned out that the ori- 
gin for the power-law decay of the autocorrelation func- 
tions is the hierarchical organization of the configuration 
space; the spins (or the random walker) overcome the 
dynamic barriers successively expanding the number of 




1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 
FIG. 6: Ultrametric space of 16 states. 



accessible configurations. We note that this phenomenon 
is very similar to the one observed in the diffusion in an 
ultrametric space jlSE^I- In this section, we compare 
ultrametric diffusion with the random walk problem we 
have studied in this paper. 

Consider a dynamical system with N states a = 
1,2, ...,N. The system in state a may perform tran- 
sitions to any other state b with a transition probability 
w a b- One can define the distance between two states as 
dab = l/wa& and thus provide the state space with a 
metric. If the transition probabilities satisfy the relation 
l/w a b < sup(l/u; ac ; 1/wbc) for all a, 6, and c, the cor- 
responding metric is called an ultrametric and the state 
space is an ultrametric space. 

The simplest example of an ultrametric space is rep- 
resented by a rooted tree generated as follows: We start 
from a single vertex at the i?th hierarchy and branch B 
vertices in the next (R — l)th hierarchy. Each of them 
branches into B vertices. It is repeated until one has 
N = B R vertices at the zeroth or bottom level. One 
then associates the vertices at the bottom level with the 
N states. The transition probabilities between two states 
are assigned to w a b = e~ dA , where A > is a constant 
and d is the hierarchical distance between them, namely 
the hierarchy level of their common ancestor at the low- 
est level. It is easy to see that the transition probabilities 
satisfy the ultrametric relation, and thus an ultrametric 
space of N states is obtained. As an example, we illus- 
trate in Fig.Elthe rooted tree with R = 4 and B = 2 for 
an ultrametric space of N — 16 states. In this example, 
two states 1 and 7 have the common ancestors at the 



hierarchy level h — 3 and 4, hence w\ 7 = e , while 
ti>l,9 = e~ 4A 

The autocorrelation function can be calculated exactly, 
see e.g., Ref. [25|. The exact result is also understood 
with a simple scaling argument. Suppose that the sys- 
tem is in a state a initially. Since the transition prob- 
ability to a state at the hierarchical distance £ is given 
by w — e~ A ^ and there are O(B^) such states, it takes 
t£ ~ (_B^e _A ^) _1 time steps for the system to reach one 
of the states within the hierarchical distance £. Hence, 
the autocorrelation function at time t ~ t^ is given by 
C(t € ) - B~t. Eliminating £, one obtains that the auto- 
correlation function decays algebraically as C(t) ~ t~ a 
with a = ln£>/(A — lnB). The power-law decay is 
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valid for A > \nB, while the dynamics is unstable for 
A < lni?. At the marginal stretched exponential 

decay P(t) ~ e -(in-B)t 1/7 ma y occur when the transition 
probability decreases as w (d) ~ d-~*e-( lnB '> d with the 
hierarchical distance [2^ |2g] . 

Comparing the phenomenology, it is clear that the dif- 
fusion in the hierarchical network is essentially the same 
as the ultramctric diffusion. In both processes, the relax- 
ation takes place by overcoming dynamic barriers suc- 
cessively and increasing associated length scale. The 
length scale corresponds to the perturbed domain size 
£(t) ~ lni/ln/i in the former, and to the hierarchical 
distance ~ lni/ln(A - Inf?) in the latter. The 
length scale grows logarithmically in time, which is a 
consequence of the exponential increase of the dynam- 
ical barrier height. 

Note, however, that the diffusion in the hierarchical 
network is not the ultramctric diffusion in a strict sense 
since the ultrametric relations are not valid. The configu- 
ration space of the Ising spin system has a tree structure 
with all vertices corresponding to physical states. The 
ultrametricity would hold only if vertices at the bottom 
hierarchy would represent physical states, see Figs.|5]and 
|SJ Such a difference does not modify the ultrametric na- 
ture of the relaxation from the state \A1) and \A2), which 
are located at the end branch in the configuration space. 
On the other hand, the relaxation from \H) and |P), 
which are in the center of the configuration space tree, 
are influenced by the non-ultrametricity. It is reflected 
in the G _1 and G~ 2 factors in the autocorrelation func- 
tions Cp{t) and Cjj(t), respectively. Pseudo- ultrametric 
diffusion is also observed for the random walks on a tree 
structure [2jj and on the one-dimensional lattice with 
hierarchically distributed dynamic barriers |2S| . 



VI. SUMMARY 

In summary, we have studied the random walk prob- 
lem on the hierarchical network. The random walk prob- 
lem on the network of N — M nodes is mapped to a 
specially constrained dynamics of a M-state Potts spin 
chain of length G. Using the symmetry property, it 
is further mapped to a specially constrained dynam- 
ics of an Ising spin chain. From the analysis of the 
MFPT, it is shown that the characteristic relaxation time 
scales as T ~ k g ~ JV Z with k = M/(M ~ 1) and 
z = lnre/lnM. It is also shown that the autocorrelation 
function decays algebraically in time as Ccr(t) ~ t~ a v 
for t <C T with a non-universal (i.e. state-dependent) ex- 
ponent eta ■ The power-law scaling behavior is closely re- 
lated to the ultrametric diffusion. The exponent is given 
by ot a — In To- 1 In k for a state <r whose stationary state 
probability is ~ r^P . The stationary state probabil- 
ity is determined from the degree of the corresponding 
nodes in the network. The broad distribution of the de- 
gree gives rise to the non-universality (state-dependency) 
of the decay exponent. 



The power-law decay of the autocorrelation functions 
appears in marked contrast to the stretched-exponential 
decay in random networks and in the small-world 
networks ^(|. In order to investigate the origin of the 
emergence of the power-law scaling, we have also stud- 
ied the random walks on the hierarchical networks with 
M = 2. At M — 2, the hierarchical network is not 
scale-free any more. Nevertheless, we can use the same 
mapping to the Ising spin system with the configura- 
tion space of the same tree structure. So we can ob- 
tain the scaling behaviors of the relaxation time T us- 
ing Eqs. 126( 1 and l|27|l . and of the autocorrelation func- 
tion using the same scaling arguments: The relaxation 
time scales as T ~ G ln2 ~ N 1 . And the autocorrelation 
functions decay algebraically in time with the universal 
(state-independent) exponent, i.e., an = OLp = ola = 1. 
For M = 2, the corresponding spin dynamics has the 
spin up-down symmetry. So, Cn{t) and Cp(t) decay 
in the same way as Cji(t) — Cp(t) ~ t~ 1 /G with the 
same dependency on G. Finally, the scaling behavior of 
the relaxation time and the autocorrelation functions was 
confirmed numerically. 

Comparing the results for M — 2 and M > 2, we 
conclude that the power-law scaling behavior of the re- 
laxation time and the autocorrelation functions has its 
origin in the tree structure of the spin configuration space 
as shown in Fig. [21 We also conclude that the non- 
universality of the decay exponent for M > 2 results 
from the scale-free degree distribution. 

The hierarchical network itself does not have a tree 
structure. But, after the mapping, the random walk 
problem on the network reduces to that on the tree struc- 
ture. In general, it is not known a priori whether such 
a mapping exists for an arbitrary network. It would be 
interesting to study the random walk problem on gen- 
eral networks in order to scrutinize the robustness of the 
power-law scaling behavior and the effect of the scale- 
free degree distribution on the relaxation dynamics. Such 
work is actually in progress. 

We note that the very slow relaxation dynamics of the 
Ising chain representation of the random walk problem on 
the hierarchical network is due to the severe constraints 
of the dynamics imposed by the restrictions for possible 
transitions. Constrained dynamics in otherwise (for in- 
stance thermodynamically) very simple models lead quite 
frequently to a slow or glassy dynamics |29|. for which 
reason kinetically constrained models are often used as 
models for the dynamics in glasses and spin glasses. It 
is interesting to note that such a model also occurs in 
the context of diffusion in complex networks as we have 
demonstrated in this work. 
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